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What is claimed is: 

1 . A method for automatically classifying spectral properties of audio data, comprising: 
applying input audio data (1) to a critical band filtering process to form first output 

data and (2) to an entropy calculation process to form second output data; 
5 applying the first output data to a first derivative process to form third output data; and 

inputting said first, second and third output data to an averaging process to form a 
spectral feature vector representing the input audio data. 

2. A method according to claim 1, wherein the audio data is divided into firames, and the 
1 0 method is performed frame by frame. 

3. A method according to claim 1, further including calculating root mean squared 
values of the input audio data. 

15 4. A method according to claim 2, wherein said entropy calculation process includes 
calculating: 

where S is the entropy of the frame, n is the normalized magnitude of a bin w of the audio 
data, and log2( 7) )is the log base 2 of ( n ). 

20 

5. A method according to claim 2, wherein said first output data output from said critical 
band filtering process includes, for each critical band located due to the critical band filtering 
process, data resulting from summing the value of the square of the magnitude of each bin of 
data in the frame. 

25 

6. A method according to claim 2, wherein said first derivative process that forms said 
output data includes, for each critical band located due to the critical band filtering process, 
calculating the first derivative of data for each bin of data in the frame to gain information 
about the rate of change of the spectral frequencies represented by the frame. 

30 
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7. The method of claim 1 , further comprising converting the input audio data from the 
time domain to the frequency domain. 



8. A method according to claim 7, wherein said converting of the input audio data signal 
5 from the time domain to the frequency domain includes performing a fast fourier transform 

on the audio data. 

9. A method according to claim 2, wherein the averaging process is an averaging process 
over all of the frames to form the spectral feature vector for the audio data. 

10 

10. A method according to claim 1 , further comprising applying the output vector to a 
classification process which determines at least one of (1) at least one spectral properties 
value and (2) at least one spectral properties class that describes the audio data. 

15 11, A method according to claim 1 , wherein the spectral feature vector for the audio data 
is a vector that is 1 x 25. 

12. A method according to claim 1, wherein the audio data is formatted according to pulse 
code modulated format. 

20 

13. A method according to claim 12, wherein the audio data is previously in a format 
other than pulse code modulated format, and the method further comprises converting the 
audio data to pulse code modulated format from the other format. 

25 14. The method of claim 1, further comprising converting the input audio data from the 
time domain to the frequency domain. 

15. A method according to claim 12, wherein said converting of the input audio data 
signal from the time domain to the frequency domain includes performing a fast fourier 
30 transform on the audio data. 
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16. A method according to claim 2, wherein the averaging process is an averaging process 
over all of the frames to form the spectral feature vector for the audio data. 

5 17. A method according to claim 1 , further comprising performing a principal component 
analysis process on the spectral feature vector. 

18. A computer readable medium bearing computer executable instructions for carrying 
out the method of claim 1 . 

10 

19. A modulated data signal carrying computer executable instructions for performing the 
method of claim 1. 

20. At least one computing device comprising means for performing the method of 
15 claim 1. 

21. A method of classifying data according to spectral properties of the data, comprising: 
assigning to each media entity of a plurality of media entities in a data set to at least 

one spectral properties class; 
20 processing each media entity of said data set to extract at least one spectral properties 

characteristic based on digital signal processing of each media entity; 

generating a plurality of spectral properties vectors for said plurality of media entities, 

wherein each spectral properties vector includes said at least one spectral properties class and 

at least one spectral properties characteristic based on digital signal processing; and 
25 forming a classification chain based upon said plurality of feature vectors, 

22. A method according to claim 21, further comprising: 

processing an unclassified media entity to extract at least one spectral properties 
characteristic based on digital signal processing of the unclassified media entity; 
30 generating a vector for the unclassified media entity including said at least one digital 

signal processing spectral properties characteristic; 
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presenting the vector for the unclassified media entity to the classification chain; and 
classifying the unclassified entry with an estimate of the spectral properties class by 
calculating the representative spectral properties class of the subset of the plurality of vectors 
of the classification chain located in the neighborhood of the vector for the unclassified 
5 entity. 

23. A method according to claim 22, further including calculating a neighborhood 
distance that defines a distance within which two vectors in the classification chain space are 
in the same neighborhood for purposes of being in the same spectral properties class. 

10 

24. A method according to claim 22, wherein said classifying of the unclassified entry 
includes classifying the unclassified entry with a median spectral properties class represented 
by the neighborhood. 

15 25. A method according to claim 22, wherein said spectral properties class is described by 
a numerical value and said classifying of the unclassified entry includes classifying the 
unclassified entry with a mean of numerical spectral properties values found in the 
neighborhood. 

20 26. A method according to claim 22, wherein said classifying includes returning at least 
one number indicating the level of confidence of the spectral properties class estimate. 

27. A computer readable medium bearing computer executable instructions for carrying 
out the method of claim 21. 

25 

28. A modulated data signal carrying computer executable instructions for performing the 
method of claim 21. 

29. At least one computing device comprising means for performing the method of 
30 claim 21. 
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30. A computing system, comprising: 
a computing device including: 

a classification chain data structure stored ftiereon having a plurality of classification 
vectors, wherein each vector includes data representative of a spectral properties class as 
5 classified by humans and spectral properties characteristics as determined by digital signal 
processing; and 

processing means for comparing an unclassified media entity to the classification 
chain data structure to determine an estimate of the spectral properties class of the 
unclassified media entity. 

10 

31. A computing system according to claim 30, wherein said determining of an estimate 
of the spectral properties class includes returning at least one number indicating the level of 
confidence of the spectral properties class assignment. 

15 32. A method according to claim 3 1 , wherein the performance level of the classification 
chain improves over time due to the examination of unclassified media entities that have a 
low confidence level associated with the spectral properties class assignment. 

33. A classification chain data structure utilized in connection with the classification of 
20 spectral properties of new unclassified media entities, comprising; 

a plurality of classification vectors, wherein each vector includes: 
spectral properties data as classified by humans; and 
spectral properties data determined by digital signal processing techniques. 

25 34. A method for classifying data according to its spectral properties, comprising: 
a construction phase, comprising: 

classifying by human experts a representative set of sounds according to their 
spectral perceptual qualities; 

assigning each entry in the representative set at least one value; 
30 reducing the results of the construction phase to a set of numbers called the 

characteristic vector of each sound; and 
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storing the characteristic vector in a classification chain for later calculations; 



and 



5 



a classification phase, comprising: 

presenting an unclassified sound for classification; 
calculating the characteristic vector of the unknown sound; and 



presenting the characteristic vector to the classification chain, which returns an 
estimate of the spectral properties of the unknown sound. 

35. The method of Claim 34, wherein the reducing of the results of the construction phase 
10 to a set of numbers called the characteristic vector of each sound includes breaking up the 
sound into a plurality of frames of a fixed number of pulse code modulation values, each 
value representing a sample in the fi:ame, determining the energy of the fi:ame by calculating 
the root mean squared value of the firame, taking a fast fourier transform of the root mean 
squared value, and calculating the entropy content by normalizing the sum of the magnitudes 
15 of the bins of the fast fourier transform to unity for each firame and then calculating: 



w 



where S is the entropy of the firame, is the normalized magnitude of a bin w of the audio 



w 



data, and log2( pj is the log base 2 of ( p ), and calculating the mean and the standard 
deviation of each resulting value. 



20 



